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WHAT IS CLAIMED IS: 

1. An information processing method comprising: 
a viewpoint position/sight line direction 

determination step of determining a viewpoint 
5 position and a sight line direction on a map; 

an annotation display position determination 
step of determining an annotation display position of 
an object, from the position of said object on the 
map determined based on observation directions of 
10 said object in plural panoramic images, the viewpoint 
position, and the sight line direction; and 

a synthesis step of synthesizing an annotation 
image to the annotation display position on an 
actually taken image corresponding to the viewpoint 
15 position. 

2. An information processing method according 
to Claim 1, wherein the map is a two-dimensional map 
image . 

20 

3. An information processing method according 
to Claim 1, wherein said annotation display position 
determination step determines the annotation display 
position of the panoramic image located between said 

25 plural panoramic images, by using the determined 
position of the object on the map. 
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4 . An information processing method according 
to Claim 3, wherein the determined annotation display 
position can be manually adjusted. 

5 5 . An information processing method according 

to Claim 1, wherein 

a graphical user interface including a map 
display portion and a panoramic image display portion 
is provided, 

10 said plural panoramic images are selected by 

using the map display portion, and 

the observation direction of the object is 
designated on the selected panoramic image displayed 
on the panoramic image display portion. 

15 

6. A control program for causing a computer to 
execute a information processing method comprising: 

a viewpoint position/sight line direction 
determination step of determining a viewpoint 
20 position and a sight line direction on a map; 

an annotation display position determination 
step of determining an annotation display position of 
an object, from the position of said object on the 
map determined based on observation directions of 
25 said object in' plural panoramic images, the viewpoint 
position, and the sight line direction; and 

a synthesis step of synthesizing an annotation 



- 40 - 



image to the annotation display position- on an 
actually taken image corresponding to the viewpoint 
position . 

5 7. An information processing method, used in an 

image reproduction apparatus for achieving walk- 
through in a virtual space represented by using an 
actually taken image, of synthesizing an annotation 
image to the actually taken image, said method 
10 comprising the steps of: 

setting an annotation display position in each 
of the plural actually taken images; 

calculating an annotation display position to 
another actually taken image located between the 
15 plural actually taken images, by using the annotation 
display positions respectively set in the plural 
actually taken images; and 

synthesizing the annotation image to the 
actually taken image on the basis of the calculated 
20 annotation display position. 

8. An information processing method according 
to Claim 7, wherein 

the setting of the annotation display position 
25 in each of the plural actually taken images is 

performed according to a user's manual instruction, 
and 
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the calculated annotation display position can 
be adjusted based on a user's manual instruction. 

9. An information processing method according 
5 to Claim 7, wherein the annotation display position 

to said another actually taken image is calculated by 
performing interpolation to the annotation display 
position set in each of the plural actually taken 
images. 

1Q 

10. An information processing method according 
to Claim 9, wherein 

the interpolation is non-linear interpolation, 

and 

15 from among plural non-linear curves previously 

held, the non-linear curve is determined based on the 
annotation position of the object in each of the 
plural actually taken images. 

20 11. A control program for causing a computer to 

• execute a information . processing method, used in an 
image reproduction apparatus for achieving walk- 
through in a virtual space represented by using an 
actually taken image, of synthesizing an annotation 
25 image to the actually taken image, said method 
comprising the steps of: 

setting an annotation display position in each 
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of the plural actually taken images; 

calculating an annotation display position to 
another actually taken image located between the 
plural actually taken images, by using the annotation 
5 display positions respectively set in the plural 
actually taken images; and 

synthesizing the annotation image to the 
actually taken image on the basis of the calculated 
annotation display position. 

.10 

12. An image reproduction apparatus comprising: 
a viewpoint position/sight line direction 
determination unit, adapted to determine a viewpoint 
position and a sight line direction on a map; 
15 an annotation display position determination 

unit, adapted to determine an annotation display 
position of an object from the position of said 
object on the map determined based on observation 
directions of said object in plural panoramic images, 
20 the viewpoint position, and the sight line direction; 
and 

an image reproduction control unit, adapted to 
synthesize an annotation image to the annotation 
' display position on an actually taken image 
25 corresponding to the viewpoint position. 



